PRELIMINARY AMENDMENT 
Appln. No.: 09/844,232 



PATENT APPLICATION 



AMENDMENTS TO THE CLAIMS : 

Add new claims 87-120 so that the claims read as follows: 

1. (Original) A three dimensional inspection system for 
inspecting ball array devices having a plurality of balls, wherein 
the ball array device is positioned in an optical system, the 
inspection system comprising: 

a) an illuminator located to illuminate at least one ball on 
the ball array device; 

b) a sensor; 

c) a first optical element positioned to transmit light to 
the sensor; 

d) a second optical element positioned to direct light from 
the at least one ball to the sensor, where the sensor, the first 
optical element and the second optical element cooperate to obtain 
at least two differing views of the at least one ball, the sensor 
providing an output representing the at least two differing views ; 
and 

e) a processor, coupled to receive the output, where the 
processor processes the output by using a triangulation method to 
calculate a three dimensional position of the at least one ball 
with reference to a pre-calculated calibration plane. 
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2. (Original) The three dimensional inspection apparatus of 
claim 1 wherein the calibration plane comprises a coordinate 
system having X, Y and Z axes and wherein an X measurement value 
is proportional to a Z measurement value . 

3. (Original) The three dimensional inspection apparatus of 
claim 1 wherein the calibration plane comprises a coordinate 
system having X, Y and Z axes and wherein an XY measurement value 
is proportional to a Z measurement value. 

4. (Original) The three dimensional inspection apparatus of 
claim 1 wherein the calibration plane comprises a coordinate 
system having X, Y and Z axes and wherein a Y measurement value is 
proportional to a Z measurement value. 

5. (Original) The three dimensional inspection apparatus of 
c r laim 1 wherein the triangulation calculations are based on 
determining a center of the ball in a first view and determining a 
ball top location in a second view. 

6. (Original) The three dimensional inspection apparatus of 
claim 1 wherein the pre-calculated calibration plane is defined by 
measuring a calibration pattern. 
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7. (Original) The three dimensional inspection apparatus of 
claim 1 wherein the second optical element comprises a mirror. 

8. (Original) The three dimensional inspection apparatus of 
claim 1 wherein the second optical element comprises a prism. 

9. (Original) The three dimensional inspection apparatus of 
claim 1 wherein one of the at least two differing views is 
obtained at a low angle of view. 

10. (Original) The three dimensional inspection apparatus of 
claim 1 wherein the sensor and the second optical element are 
positioned to receive light from different angles relative to the 
calibration plane. 

11. (Original ) The three dimensional inspection apparatus of 
claim 1 wherein the sensor comprises a charged coupled device 
array. 

12. (Original) The three dimensional inspection apparatus of 
claim 1 wherein the sensor comprises a complementary metal oxide 
semiconductor device array. 

13. (Original) The three dimensional inspection apparatus of 
claim 1 wherein the triangulation method comprises measurements 
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derived from the at least two differing views include grayscale 
edge detection to locate ball positions. 

14. (Original ) The three dimensional inspection apparatus of 
claim 1 wherein the measurements include threshold analysis. 

15. (Original) The three dimensional inspection apparatus of 
claim 1 wherein the first optical element comprises a lens. 

16. (Original) The three dimensional inspection apparatus of 
claim 1 wherein the first optical element comprises a pin-hole 
lens. 

17. (Original) The three dimensional inspection apparatus of 
claim 1 wherein the first optical element comprises a plurality 

of lens elements. 

18. (Original) The three dimensional inspection apparatus of 
claim 1 wherein the first optical element comprises a telecentric 
lens . 

19. (Original) The three dimensional inspection apparatus of 
claim 1 wherein the ball array devices comprise ball grid array 
devices . 
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20. (Original) The three dimensional inspection apparatus of 
claim 1 wherein the ball array devices comprise bump on wafer 
devices . 

21. (Original) The three dimensional inspection apparatus of 
claim 1 wherein the processor comprises a personal computer. 

22. (Original) The three dimensional inspection apparatus of 
claim 1 wherein the sensor includes a solid state sensor array. 

23. (Original) The three dimensional inspection apparatus of 
claim 1 wherein one of the views comprises a segment having a 
crescent shape. 

24. (Original) A three dimensional inspection apparatus for 
ball array devices having a plurality of balls, the apparatus 
comprising : 

a) an illuminator positioned to produce reflections from the 
ball array device; 

b) a sensor disposed to receive light at a first angle 
relative to the ball array device; 

c) a first optical element positioned to transmit light to 
the sensor, where the sensor obtains a first view of the ball 
array device ; 
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d) a second optical element disposed to receive light at a 
second angle different from the first angle and to transmit a 
second view of the ball array device to the sensor; 

e) a frame grabber coupled to the sensor to transmit image 
information from the sensor; and 

f) a processor, coupled to receive the image information, 
where the processor applies triangulation calculations to 
measurements of the image information so as to calculate a three 
dimensional position of at least one ball with reference to a pre- 
calculated calibration plane. 

25. (Original) The three dimensional inspection apparatus of 
claim 24 wherein the calibration plane comprises a coordinate 
system having X, Y and Z axes and wherein an X measurement value 
is proportional to a Z measurement value. 

26. (Original) The three dimensional inspection apparatus 
of claim 24 wherein the calibration plane comprises a coordinate 
system having X, Y and Z axes and wherein an XY measurement value 
is proportional to a Z measurement value. 

27. (Original) The three dimensional inspection apparatus 
of claim 24 wherein the calibration plane comprises a coordinate 
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system having X, Y and Z axes and wherein a Y measurement value 
is proportional to a Z measurement value. 

28. (Original) The three dimensional inspection apparatus 
of claim 24 wherein the pre-calculated calibration plane is 
defined by measuring a calibration pattern. 

29. (Original) The three dimensional inspection apparatus of 
claim 24 wherein the second optical element comprises a mirror. 

30. (Original ) The three dimensional inspection apparatus of 
claim 24 wherein the second optical element comprises a prism. 

31. (Original ) The three dimensional inspection apparatus of 
claim 24 wherein the illuminator comprises a ring light. 

32. (Original) The three dimensional inspection apparatus of 
claim 24 wherein the illuminator comprises a plurality of light 
emitting diodes. 

33. (Original) The three dimensional inspection apparatus of 
claim 24 wherein the illuminator comprises reflected light. 

34. (Original ) The three dimensional inspection apparatus of 
claim 24 wherein the sensor comprises a charged coupled device 
array. 
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35. (Original ) The three dimensional inspection apparatus of 
claim 24 wherein the sensor comprises a complementary metal oxide 
semiconductor device array. 

36. (Original) The three dimensional inspection apparatus of 
claim 24 wherein the ball array devices comprise ball grid array 
devices . 

37. (Original) The three dimensional inspection apparatus of 
claim 24 wherein the ball array devices comprise bump on wafer 
devices . 

38. (Original) The three dimensional inspection apparatus of 
claim 24 wherein the measurements from the first image and the 
second image include grayscale edge detection to locate ball 
positions . 

39. (Original) The three dimensional inspection apparatus of 
claim 24 wherein the measurements include threshold analysis. 

40. (Original) The three dimensional inspection apparatus of 
claim 24 wherein the first optical element comprises a lens. 
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41. (Original) The three dimensional inspection apparatus of 
claim 24 wherein the first optical element comprises a pin-hole 
lens . 

42. (Original) The three dimensional inspection apparatus of 
claim 24 wherein the first optical element comprises a plurality 
of lens elements. 

43. (Original) The three dimensional inspection apparatus of 
claim 24 wherein the first optical element comprises a telecentric 
lens . 

44. (Original) The three dimensional inspection apparatus of 
claim 24 wherein the illuminator comprises a ring light. 

45. (Original) The three dimensional inspection apparatus of 
claim 24 wherein the sensor includes a solid state sensor array. 

46. (Original) The three dimensional inspection apparatus of 
claim 24 wherein the processor comprises a personal computer, 

47. (Original) The three dimensional inspection apparatus of 
claim 24 wherein the second optical element reflects a view to the 
sensor where at least one ball of the ball array device exhibits a 
crescent shape . 
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48. (Original ) A three dimensional inspection apparatus for 
ball array devices having a plurality of balls, the apparatus 
comprising : 

a) an illuminator disposed to illuminate a ball array device; 

b) a sensor disposed to receive light at a first angle 
relative to to the ball array device, and wherein the sensor 
includes a solid state sensor array; 

c) a first optical element positioned to transmit light to 
the sensor, where the sensor obtains a first view of the ball 
array device; 

d) a second optical element disposed to receive light at a 
second angle different from the first angle and to transfer a 
second view of the ball array device to the sensor; 

e) an image acquisition apparatus coupled to the sensor to 
transmit image information representing the first view and the 
second view; and 

f) a processor, coupled to receive the image information, 
where the processor applies triangulation calculations to 
measurements of the image information so as to calculate a three 
dimensional position of at least one ball with reference to a 
pre-calculated calibration plane, wherein the calibration plane 
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comprises a coordinate system having X, Y and Z axes, and wherein 
an X measurement value is proportional to a Z measurement value. 

49. (Original) The three dimensional inspection apparatus 

of claim 48 wherein an XY measurement value is proportional to a Z 
measurement value . 

50. (Original ) The three dimensional inspection apparatus 
of claim 48 wherein a Y measurement value is proportional to a Z 
measurement value. 

51. (Original ) The three dimensional inspection apparatus 
of claim 48 wherein the pre-calculated calibration plane is 
defined by measuring a calibration pattern. 

52. (Original ) The three dimensional inspection apparatus 
of claim 48 wherein the measurements include grayscale edge 
detection to locate ball positions. 

53. (Original) The three dimensional inspection apparatus 
of claim 48 wherein the measurements include threshold analysis. 

54. (Original) The three dimensional inspection apparatus 
of claim 48 wherein the illuminator comprises a plurality of 
light emitting diodes. 
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55. (Original) The three dimensional inspection apparatus 
of claim 48 wherein the illuminator comprises reflected light. 

56. (Original) The three dimensional inspection apparatus 
of claim 48 wherein the ball array devices comprise ball grid 
array devices . 

57. (Original) The three dimensional inspection apparatus 
of claim 48 wherein the ball array devices comprise bump on wafer 
devices . 

58. (Original ) The three dimensional inspection apparatus 
of claim 48 wherein the solid state sensor array includes a 
charged coupled device array. 

59. (Original) The three dimensional inspection apparatus 
of claim 48 wherein the solid state sensor array includes a 
complementary metal oxide semiconductor array. 

60. (Original) The three dimensional inspection apparatus 
of claim 48 wherein the second optical element comprises a 
mirror . 

61. (Original) The three dimensional inspection apparatus 
of claim 48 wherein the second optical element comprises a prism. 
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62. (Original) The three dimensional inspection apparatus 
of claim 48 wherein the second view comprises a segment having a 
crescent shape. 

63. (Original) The three dimensional inspection apparatus 
of claim 48 wherein the image acquisition apparatus comprises a 
frame grabber. 

64. (Original) The three dimensional inspection apparatus 
of claim 48 wherein the processor comprises a personal computer. 

65. (Original) The three dimensional inspection apparatus 
of claim 48 wherein the first optical element comprises a lens. 

66. (Original) The three dimensional inspection apparatus 
of claim 48 wherein the first optical element comprises a pin- 
hole lens. 

67. (Original) The three dimensional inspection apparatus 
of claim 48 wherein the first optical element comprises a 
plurality of lens elements. 

68. (Original) The three dimensional inspection apparatus 
of claim 48 wherein the first optical element comprises a 
telecentric lens. 
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69. (Original) The three dimensional inspection apparatus 
of claim 1 further comprising a diffuser disposed to provide 
illumination for imaging of a perimeter of the ball array device. 

70. (Original) The three dimensional inspection apparatus 
of claim 24 further comprising a diffuser disposed to provide 
illumination for imaging of a perimeter of the ball array device. 

71. (Original) The three dimensional inspection apparatus 
of claim 48 further comprising a diffuser disposed to provide 
illumination for imaging of a perimeter of the ball array device. 

72. (Original) A three dimensional inspection apparatus for 
ball array devices having a plurality of balls, wherein the ball 
array device is positioned in a fixed optical system, the 
apparatus comprising : 

a) an illumination apparatus positioned for illuminating the 
ball array device; 

b) a camera disposed in a fixed focus position relative to 
the ball array device for taking a first image of the ball array 
device to obtain a circular doughnut shape image from at least 
one ball; 

c) an optical element disposed in a fixed focus position 
relative to the ball array device for transmitting a second image 
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of the ball array device to the camera to obtain a side view 
image of the at least one ball; and 

d) a processor, coupled to receive the first image and the 
second image, that applies triangulation calculations on related 
measurements of the first image and the second image to calculate 
a three dimensional position of the at least one ball with 
reference to a pre-calculated calibration plane. 

73. (Original) The three dimensional inspection apparatus 
of claim 72 wherein the second image comprises a segment having a 
crescent shape. 

74. (Original) The three dimensional inspection apparatus 
of claim 72 wherein the calibration plane comprises a coordinate 
system having X, Y and Z axes and wherein an X measurement value 
is proportional to a Z measurement value. 

75. (Original) The three dimensional inspection apparatus 
of claim 72 wherein the triangulation calculations are based on 
determining a center of the ball in the first image and 
determining a ball top location in the second image. 
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76. (Original) The three dimensional inspection apparatus 
of claim 72 wherein the pre-calculated calibration plane is 
defined by measuring a calibration pattern. 



77. (Original) The three dimensional inspection apparatus 
of claim 72 wherein the optical element comprises a mirror that 
reflects light between the ball array device and the camera. 

78. (Original) The three dimensional inspection apparatus 

of claim 72 wherein the second image is obtained at a low angle of 
view . 



79. (Original) The three dimensional inspection apparatus 
of claim 72 wherein the camera and the optical element are fixed 
at different angles relative to the calibration plane. 

80. (Original ) The three dimensional inspection apparatus 
of claim 72 wherein the camera comprises a charged coupled device 
array . 

81. (Original) The three dimensional inspection apparatus 
of claim 72 wherein the measurements from the first image and the 
second image include grayscale edge detection to locate ball 
positions . 
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82. (Original) The three dimensional inspection apparatus 
of claim 72 wherein the illumination apparatus further comprises 
a diffuser. 

83. (Original) The three dimensional inspection apparatus 
of claim 72 wherein the ball array devices comprise ball grid 
array devices. 

84. (Original) The three dimensional inspection apparatus 
of claim 7 2 wherein the ball array devices comprise bump on wafer 
devices . 

85. (Original) The three dimensional inspection apparatus of 
claim 72 wherein the camera comprises a complementary metal oxide 
semiconductor device array. 

86. (Original) The three dimensional inspection apparatus of 
claim 72 wherein the triangulation calculations include threshold 
analysis . 

87 . (New) An apparatus for three dimensional inspection of a 
lead on a ball array device, the apparatus comprising: 

one or more light sources providing illumination to the lead; 
fixed optical elements disposed so as to obtain both a bottom 
view of the lead and a side perspective view of the lead; 
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a camera disposed so as to receive from the fixed optical 
elements at least the bottom view and the side perspective view of 
the lead; 

a memory connected to receive from the camera as pixel values 
the bottom view and the side perspective view of the lead; 

a processor connected to the memory, the processor 
implementing software instructions adapted to cause the processor 
to execute the following actions: 

^ determining a first lead reference pixel position in the 

bottom view; 

determining a second lead reference pixel position in 
the side view; 

converting the first and second lead reference pixel 
positions into a world value by using pixel values and 
parameters determined during a calibration. 

88. (New) The apparatus of claim 87, wherein a single light 
source illuminates the lead. 

89. (New) The apparatus of claim 87, wherein more than one 
light source illuminates the lead. 
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90. (New) The apparatus of claim 87, wherein the bottom view 
of the lead and a side perspective view of the lead are obtained 
in a single image. 

91. (New) The apparatus of claim 87, wherein the bottom view 
of the lead and a side perspective view of the lead are obtained 
in more than one image . 

92. (New) The apparatus of claim 87, wherein the parameters 
determined during the calibration are selected from the group 
consisting of: pixel scale factors, an angle at a particular point 
in a view, and correspondence of one or more pixel values to world 
values . 

93. (New) The apparatus of claim 87, wherein the calibration 
includes resolving missing state values of an inspection system by 
imaging a precision pattern of known dimensions and spacing. 

94. (New) The apparatus of claim 87, wherein the calibration 
includes determining and storing pixel values of features of a 
precision pattern of known dimensions and spacing. 

95. (New) The apparatus of claim 87, wherein the calibration 
includes determining and storing deviations from ideal world 
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locations of features of a precision pattern of known dimensions 
and spacing. 

96. (New) The apparatus of claim 87, wherein a Z value is 
calculated by combining a deviation of the first lead reference 
pixel position from its ideal position with a deviation of the 
second lead reference pixel position from its ideal position. 

97. (New) The apparatus of claim 87, wherein the software 
instructions are further adapted to cause the processor to execute 
the further action of: 

converting world values to Z deviations by calculating 
deviation values that represent the deviation of the lead from its 
ideal position. 

98. (New) The apparatus of claim 87, wherein the software 
instructions are further adapted to cause the processor to execute 
the further action of: 

converting world values to coplanarity values by calculating 
deviation values that represent the deviation of the lead from a 
reference plane. 
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99. (New) The apparatus of claim 87, wherein the software 
instructions are further adapted to cause the processor to execute 
the further action of: 

converting world values to coplanarity values by calculating 
deviation values that represent the deviation of the lead from a 
seating plane. 

100. (New) The apparatus of claim 87, wherein the one or 
more light sources comprise a diffuse light. 



101. (New) The apparatus of claim 87, wherein the one or 
more light sources provide a diffuse light for the bottom view of 
the lead. 

102. (New) The apparatus of claim 87, wherein the one or 
more light sources provide a diffuse light for the side 
perspective view of the lead. 

103. (New) The apparatus of claim 87, wherein the one or 
more light sources comprise an overhead reflective diffuser to 
enhance an image of the outline of the ball array device. 

104. (New) An apparatus for three dimensional inspection of 
a lead on a ball array device, the method comprising: 

one or more light sources providing illumination to the lead; 
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fixed optical elements disposed so as to obtain both a bottom 
view of the lead and a side perspective view of the lead; 

a camera disposed so as to receive from the fixed optical 
elements at least the bottom view and the side perspective view of 
the lead; 

a memory connected to receive from the camera as pixel values 
the bottom view and the side perspective view of the lead; 

a processor connected to the memory, the processor 
implementing software instructions adapted to cause the processor 
"cfcT execute the following actions: 

determining a first lead reference pixel position in the 
bottom view; 

determining a second lead reference pixel position in 
the side view; 

converting the first lead reference pixel position into 
a first world value and the second lead reference pixel 
position into a second world value by using pixel values and 
parameters determined during a calibration. 

105. (New) The apparatus of claim 104, wherein a single 
light source illuminates the lead. 
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106. (New) The apparatus of claim 104, wherein more than one 
light source illuminates the lead. 

107. (New) The apparatus of claim 104, wherein the bottom 
view of the lead and a side perspective view of the lead are 
obtained in a single image . 

108. (New) The apparatus of claim 104, wherein the bottom 
view of the lead and a side perspective view of the lead are 

btained in more than one image . 



109. (New) The apparatus of claim 104, wherein the 
parameters determined during the calibration are selected from the 
group consisting of: pixel scale factors, an angle at a particular 
point in a view, and correspondence of one or more pixel values to 
world values. 

110. (New) The apparatus of claim 104, wherein the 
calibration includes resolving missing state values of an 
inspection system by imaging a precision pattern of known 
dimensions and spacing. 

111. (New) The apparatus of claim 104, wherein the 
calibration includes determining and storing pixel values of 
features of a precision pattern of known dimensions and spacing. 
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112. (New) The apparatus of claim 104; wherein the 
calibration includes determining and storing deviations from ideal 
world locations of features of a precision pattern of known 
dimensions and spacing. 

113. (New) The apparatus of claim 104, wherein a Z value is 
calculated by combining a deviation of the first world value from 
its ideal position with a deviation of the second world value from 
its ideal position. 

114. (New) The apparatus of claim 104, wherein the software 
instructions are further adapted to cause the processor to execute 
the further action of: 

converting world values to Z deviations by calculating 
deviation values that represent the deviation of the lead from its 
ideal position. 

115. (New) The apparatus of claim 104, wherein the software 
instructions are further adapted to cause the processor to execute 
the further action of: 

converting world values to coplanarity values by calculating 
deviation values that represent the deviation of the lead from a 
reference plane. 
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116. (New) The apparatus of claim 104, wherein the software 
instructions are further adapted to cause the processor to execute 
the further action of: 

converting world values to coplanarity values by calculating 
deviation values that represent the deviation of the lead from a 
Seating plane. 

117. (New) The apparatus of claim 104, wherein the one or 
more light sources comprise a diffuse light. 

118. (New) The apparatus of claim 104, wherein the one or 
more light sources provide a diffuse light for the bottom view of 
the lead. 

119. (New) The apparatus of claim 104, wherein the one or 
more light sources provide a diffuse light for the side 
perspective view of the lead. 

120. (New) The apparatus of claim 104, wherein the one or 
more light sources comprise an overhead reflective diffuser to 
enhance an image of the outline of the ball array device. 
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